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(54) Method of and apparatus for generating a program 



(57) A plurality of programs are generated which are 
each composed of an arrangement of basic instructions 
of plural types required to generate output data with re- 
spect to given input data of given types. Each of the pro- 
grams is executed with a computer (AGTj) until a prede- 
termined cohdition is satisfied, and the input data is given 
to the computer. Output data generated with respect to 
the input data when each of the programs is executed is 
compared with reference output data predetermined with 
respect to the input data, and an energy value indicative 
of the quality level of each of the programs is increment- 
ed or decremented such that the energy value is greater 
as the degree with which the generated output data and 
the reference output data agree with each other is higher. 
Each of the programs is copied or eliminated depending 
on the magnitude of the energy value after the execution 
of each of the programs by the computer is finished, and 
the programs are crossed and mutated with a predeter- 
mined probability. The. above steps of executing, incre- 
menting or decrementing, copying or eliminating, cross- 
ing, and mutating are repeated to generate a program 
for generating output data with respect to the input data 
with a high degree of agreement with the reference out- 
put data. 
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Description 

The present invention relates to a method of and an apparatus for generating a program. 

Programs for generating output data (answers) with respect to input data (problems) have heretofore been used 
5 and demanded in various industrial fields. 

For example, to control the operation of a machine such as a robot with a computer, there is used a control program 
for generating output data, i.e., data representative of a control quantity for an actuator, to determine how to operate 
the machine with respect to input data, i.e., data obtained from various sensors or the like. 

Predicting future stock prices with a computer requires a program for generating output data representative of pre- 
10 dieted future stock prices from input data representative of present or past stock prices. 

The programs of the above kind are basically in the form of a mere sequence of plural basic instructions including 
arithmetic instructions, decision branch instructions, assignment instructions, input and output instructions (instructions 
to read input data and instructions to write output data). It is the current practice to rely on manual efforts of programmers 
for generating such programs, i.e., for carrying out programming. 
is A programmer generates a program usually by determining an algorithm therefor and thereafter arranging basic 

instructions according to the algorithm. An algorithm differs depending on the type of a problem, and there are generally 
various algorithms available for solving a problem because a sole algorithm is not necessarily formulated for such a 
problem. Many of such algorithms for solving the problem are not necessarily clear at the time a program is generated 
for the problem. Even when an algorithm is determined, basic instructions according to the algorithm may not necessarily 
20 be arranged in a sole formulated sequence. 

Heretofore, while part of programs or some programs of limited types may be generated in a formulated fashion 
with a computer, it has been customary to generate most other programs based on programmer's manual programming 
efforts. 

Since the conventional programming practice relies highly on programmer's manual efforts, it requires a long period 
25 of working time and the cost of programming is high. Such drawbacks grow worse as a program to be generated is more 
complex. The quality of a generated program depends basically on the ability of the programmer. Any program better 
than the generated program cannot be generated by the programmer as it exceeds the ability of the programmer. 

It is therefore an object of the present invention to provide a method of and an apparatus for generating a program 
of high quality for producing output data with respect to input data, while greatly reducing programmer's manual efforts. 
30 To achieve the above object, there is provided in accordance with a first aspect of the present invention an apparatus 

for generating a program, comprising: 

program storing means for storing a plurality of programs each composed of an arrangement of basic instructions 
of plural types required to generate output data with respect to given input data of given types; 

energy value storing means for storing data indicative of an energy value indicative of the quality level of each of 
35 the programs; 

a computer for executing each of the programs until a predetermined condition is satisfied; 
input data imparting means for giving the input data to the computer when the computer executes each of the 
programs; 

energy value setting means for setting an energy value to increment or decrement the energy value corresponding 
40 to each of the programs which is stored in the energy value storing means depending on the degree with which the 
output data generated by each of the programs executed by the computer and reference output data predetermined 
with respect to the input data agree with each other; 

selecting means for copying or eliminating each of the programs depending on the magnitude of the energy value 
stored in the energy value storing means and storing a plurality of programs generated by copying or eliminating each 
45 of the programs into the program storing means, after the execution of each of the programs by the computer is finished; 

crossing means for crossing the programs stored in the program storing means with a predetermined probability; 

and 

mutating means for mutating the programs stored in the program storing means with a predetermined probability; 
the energy value setting means having means for setting the energy value corresponding to each of the programs 
50 so as to increment the energy value when the degree with which the generated output data and the reference output 
data agree with each other is higher; 

the computer, the selecting means, the crossing means, and the mutating means having respective means for 
repeatedly executing each of the programs, copying or eliminating each of the programs, crossing the programs, and 
mutating each of the programs to generate a program for generating output data with respect to the input data with a 
55 high degree of agreement with the reference output data, in the programs stored in the program storing means. 

With the above apparatus, when each of the programs stored in the program storing means is executed by the 
program, the energy value stored in the energy value storing means is incremented by the energy value setting means 
in association with the program which generates output data with respect to the input data given by the input data 
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imparting means with a high degree of agreement with the reference output data. Specifically, in a group composed of 
the programs, each of the programs gains a highecenergy value if it can generate more accurate output data (an answer) 
with respect to given input data (a problem). Therefore, when each of the programs is copied or eliminated by the 
selecting means depending on the magnitude of an energy corresponding to each of the programs, inferior programs 

5 are deleted from the group, and a group composed of more superior programs is produced in the program storing means. 

Programs better than those programs which were most superior in the original group cannot be generated by merely 
copying or eliminating programs with the selecting means. According to the present invention, programs in the group 
are crossed (mated) by the crossing means, and mutated by the mutating means. The crossing of programs means 
exchanging portions of a pair of programs. Preferably, the crossing means comprises means for selecting at least a pair 

10 of programs as a crossing pair from the plurality of programs with a predetermined probability, and crossing the selected 
programs by exchanging a portion of an arrangement of basic instructions or a bit train of each of the selected programs 
with a predetermined probability. The mutating of programs means changing a basic instruction of a program to another 
basic instruction different therefrom. Preferably, the mutating means comprises means for mutating each of the programs 
by either changing a basic instruction of an arrangement of basic instructions of each of the programs to another basic 

is instruction with a predetermined probability or inverting the value of a bit of a bit train of each of the programs with a 
predetermined probability. 

The crossing and mutating means operate to generate programs better than those stored in the program storing 
means, as follows: 

When the programs are crossed and mutated, it is possible to generate a new program which was not present in 
20 the original group. If the generated new program is better than the programs stored in the program storing means, the 
new program can gain a higher energy value when it is executed. The program is multiplied in the group when it is copied 
by the selecting means. 

A program for generating output data, with respect to the input data with a higher degree of agreement with the 
reference output data contains a group of basic instructions or a bit train (a functional block) which is indispensable or 

25 effective to generate the output data. The program with such a functional block is copied, rather than being eliminated, 
by the selecting means, i.e., is multiplied in the group. 

In the mutating step, if the program is mutated at its functional block, then since the functional block is broken, the 
program with the broken functional block is eliminated by the selecting means. If the program is mutated at a portion 
thereof other than its functional block, then since the program remains, rather than being eliminated by the selecting 

30 means, the mutated portion remains in the program. 

In the crossing step, corresponding portions of programs are exchanged. Therefore, when programs with respective 
func f ional blocks are crossed, the functional blocks are maintained without being damaged. At the same time, when 
pro-ams with respective functional blocks are crossed, the functional blocks are maintained, and mutated portions 
accumulated in other portions of the programs than the functional blocks are crossed to generate new functional blocks 

35 jn portions other than the maintained functional blocks. Inasmuch as the programs with such newly generated functional 
blocks are capable of generating more accurate output data, the programs are multiplied by the selecting means. 

By thus repeatedly copying or eliminating, crossing, and mutating the programs depending on the energy values, 
it is possible to automatically generate, with the computer, better programs capable of generating output data with respect 
to the input data with a higher degree of agreement with the reference output data, in the group of programs stored in 

40 the program storing means. 

A program which is not eliminated or weeded out by the selecting means, i.e., a program whose corresponding 
energy value is set so as to be incremented by the energy value setting means, contains as basic instructions an input 
data reading instruction for reading the input data and a processing completion instruction for indicating the generation 
of the output data, and a group of basic instructions including arithmetic and decision branch instructions between the 

45 input data reading instruction and the processing completion instruction. The position of the group of basic instructions 
in each of the programs may not necessarily be determined, and the group of basic instructions may be included in a 
plurality of positions in each of the programs. The group of basic instructions in each of the programs may be capable 
of generating output data with respect to certain particular input data with a high degree of agreement with the reference 
output data, but may not necessarily generate output data with respect to other input data of the same type with a high 

50 degree of agreement with the reference output data. When certain particular input data is given to the program with the 
group of basic instructions upon execution of the program, a high energy value is established for the program by the 
energy value setting means when the processing completion instruction is executed. Since the program cannot generate 
accurate output data with respect to other input data, however, the program is not defined as a superior program, and 
should be weeded out quickly. 

55 For executing each of the programs with the computer, the computer is preferably able to execute the processing 

completion instruction (which may be one or more in number) contained in the program a number of times depending 
on the energy value at the time the program starts being executed. The input data imparting means preferably gives 
new input data to the computer each time the processing completion instruction is executed. In this manner, a program 
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with a high energy value upon start of its execution, i.e., a program which has generated accurate output data with 
respect to the input data when it has been executed in a preceding cycle, generates output data with respect to more 
input data when it is executed at present time. The energy value of the program is incremented or decremented de- 
pending on the degree with which the output data agrees with the reference output data. 

s Therefore, if the program is a superior program which contains only a group of basic instructions capable of gener- 

ating output data with respect to various input data, then the program gains a higher energy value each time the process- 
ing completion instruction is executed, and remains in the group of programs. Any program which is not a superior 
program often fails to generate output data with respect to various input data, even if it temporarily gains a high energy 
value when certain particular input data is given, and its energy value is decremented. Consequently, an inferior program 

w that is incapable of generating output data with respect to various input data is quickly weeded out or eliminated by the 
selecting means, and more superior programs are quickly generated in the group of programs. 

A program which is executed in the manner described above may contain an arrangement of basic instructions 
which form an infinite loop, and the computer cannot finish the execution of such a program. It is therefore preferable 
to limit the number of times that the basic instructions of each of the programs are executed, and to finish the execution 

is of the programs when the number of times that the basic instructions are executed reaches a predetermined number. 

The programs should preferably be crossed by the crossing means and mutated by the mutating means when the 
number of programs copied by the selecting means, i.e., the number of programs which gain a relatively high energy 
value upon execution thereof, reaches a certain given number or more. This is because when the number of programs 
which gain a relatively high energy value is small in the group of programs, such programs may change to inferior 

20 programs through the crossing by the crossing means or the mutation by the mutating means, and hence are highly 
likely to be eliminated by the selecting means. When the number of programs which gain a relatively high energy value 
is increased, the probability that all those superior programs change to inferior programs through the crossing by the 
crossing means or the mutation by the mutating means is small, and hence those programs are highly likely to remain 
in the group of programs. 

25 The apparatus according to the present invention preferably further comprises address data storing means for 

storing address data representing an address of at least one of the basic instructions of each of the programs stored in 
the program storing means, the basic instructions including a jump instruction for shifting the execution of the program 
to the basic instruction at the address represented by the address data stored in the address data storing means when 
each of the programs is executed by the computer. The selecting means preferably comprises means for copying or 

30 eliminating the address data stored in the address data storing means in association with each of the programs when 
each of the programs is copied or eliminated. The crossing means preferably comprises means for crossing the address 
data stored in the address data storing means with a predetermined probability in association with the programs when 
the programs are crossed. The mutating means preferably comprises means for mutating the address data stored in 
the address data storing means with a predetermined probability in association with each of the programs when each 

3$ of the programs is mutated. 

With this arrangement, when the computer executes the jump instruction during execution of each of the programs, 
the execution of the program is shifted to the basic instruction at the address represented by the address data stored 
in the address data storing means. Therefore, a train of basic instructions following the above address is processed as 
a subroutine by the computer. When the address data is copied or eliminated and crossed or mutated in association 

40 with each of the programs, it is possible to generate a program having a superior subroutine program for generating 
accurate output data. 

According to a second aspect of the present invention, there is also provided a method of generating a program, 
comprising the steps of: 

generating a plurality of programs each composed of an arrangement of basic instructions of plural types required 
45 to generate output data with respect to given input data of given types; 

executing each of the programs with a computer until a predetermined condition is satisfied and giving the input 

data to the computer; . 

comparing output data generated with respect to the input data when each of the programs is executed, with 
reference output data predetermined with respect to the input data, and incrementing or decrementing an energy value 
so indicative of the quality level of each of the programs such that the energy value is greater as the degree with which the 
generated output data and the reference output data agree with each other is higher; 

copying or eliminating each of the programs depending on the magnitude of the energy value after the execution 
of each of the programs by the computer is finished; 

crossing the programs with a predetermined probability; and 
55 mutating the programs with a predetermined probability; 

the steps of executing, incrementing or decrementing, copying or eliminating, crossing, and mutating being re- 
peated to generate a program for generating output data with respect to the input data with a high degree of agreement 
with the reference output data. 
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With the above method, as with the apparatus described above, when each of the programs is executed, the energy 
value is established therefor, each of the programs is copied or eliminated depending on the energy value thereof, and 
programs are crossed and mutated, it is possible to automatically generate, with the computer, better programs capable 
of generating accurate output data with respect to the input data. The programs are crossed and mutated in the same 
manner as the apparatus described above. 

For executing each of the programs with the computer, the computer is preferably able to execute the processing 
completion instruction contained in the program a number of times depending on the energy value at the time the program 
starts being executed. New input data is preferably given to the computer each time the processing completion instruction 
is executed. In this manner, a program which is incapable of generating accurate output data with respect to various 
input data is quickly weeded out or eliminated, and only superior programs are quickly multiplied in the group of com- 
puters. 

Preferably the number of times that the basic instructions of each of the programs are executed by the computer 
is limited, and the execution of each of the programs is finished when the above number of times reaches a predetermined 
number. In this way a program containing an arrangement of basic instructions whichform an infinite loop is prevented 
from being executed infinitely. 

The steps of crossing and mutating preferably comprise the steps of crossing the programs and mutating the pro- 
grams, respectively, when the number of copied programs reaches at least a predetermined number. Thus, superior 
programs are more likely to remain in the group of programs. 

The step of generating preferably comprises the step of establishing position data representing a position of at least 
one of the basic instructions of each of the programs in association with each of the programs. The basic instructions 
preferably include a jump instruction for shifting the execution of the program to the basic instruction at the position 
represented by the position data established in the step of establishing when each of the programs is executed by the 
computer. The step of selecting preferably comprises the step of copying or eliminating the position data in association 
with each of the programs when each of the programs is copied or eliminated. The stepof crossing preferably comprises 
the step of crossing the position data with a predetermined probability in association with the programs when the pro- 
grams are crossed. The step of mutating preferably comprises the step of mutating the position data with a predetermined 
probability in association with each of the programs when each of the programs is mutated. In this manner, it is possible 
to generate a program having a superior subroutine program for generating accurate output data. 

With the present invention, therefore, it is possible to automatically generate, with a computer, superior programs 
for generating output data with respect to input data with a high degree of agreement with reference output data, in a 
group of programs. Since most of the process of generating such superior programs is carried out by the computer, any 
manual efforts required to generate such superior programs are greatly reduced. A program for generating output data 
(an answer) from input data (a problem) is basically composed of basic instructions including input and output instruc- 
tions, decision branch instructions, arithmetic instructions, etc. Therefore, if such basic instructions are made available 
as basic instructions for programs, various programs can be generated irrespective of the type of input data. The crossing 
and mutating steps which play an important role for generating an arrangement of basic instructions effective to generate 
accurate output data are carried out in terms of probability. Therefore, the generation of such an arrangement of basic 
instructions does not depend on the human abilities, making it possible to generate superior programs which have 
heretofore not been achieved by human efforts. If the input data is regarded as a given problem and the output data as 
an answer to the problem, then since a program for generating the answer represents a process for solving the problem, 
the capability of generating a superior program which has heretofore not been achieved by human efforts signifies a 
possibility to find a new solution to a problem. Therefore, the principles of the present invention are also applicable to 
finding a new solution to a problem. 

The above and other objects, features, and advantages of the present invention will become apparent from the 
following description of a preferred embodiment of the present invention given by way of example only and with reference 
to the accompanying drawings in which: 

FIG. 1 is a block diagram of a system arrangement of an apparatus for generating a program according to the 
present invention; 

FIG. 2 is a block diagram of a portion of the apparatus shown in FIG. 1 ; 
FIG. 3 is a block diagram of a portion of the apparatus shown in FIG. 1 ; 
FIG. 4 is a flowchart of an operation sequence of the apparatus shown in FIG. 1 : 

FIG. 5 is adiagram showing the manner in which a program including ftch instructions (jump instructions) is executed; 
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FIGS. 6(a) and 6(b) are diagrams illustrative of a program crossing; and 

FIGS. 7(a) and 7(b) are diagrams illustrative of a program mutation. 

s As shown in FIG. 1 , an apparatus for generating a program according to the present invention comprises a data 

base (input data imparting means) 1 which stores a plurality of input data (problems) of the same type, a computer group 
2 composed of computers AGTj (i = 0, 1 , ...) for storing and executing a plurality of programs, respectively, to generate 
output data (answers) with respect to the input data stored in the data base 1 , a processing/supervising unit 3 for process- 
ing and supervising data, e.g., transferring data between the computer group 2, and an input/output terminal device 
w (energy value setting means) 4 for setting energy values indicative of the quality levels of the programs in the computer 
group 2. The processing/supervising unit 3 has, as its functions, a selection executing unit (selecting means) 6 for 
copying or eliminating programs, a crossing executing unit (crossing means) 7 for crossing programs, and a mutation 
executing unit (mutating means) 8 for mutating programs. 

The data base 1 has a plurality of data storage areas D n (D = 0, 1, ...) each for storing, as one set of data, input 
is data Dl, reference output data SDO required with respect to the input data Dl, and generated output data DO which is 
actually generated by a program with respect to the input data Dl. The input data Dl and the reference output data SDO 
are stored in advance in each of the data storage areas D n , and differ from data storage area to data storage area. The 
input data Dl stored in each of the data storage areas D n are composed of a plurality of partial input data d k (k = 0, 1 , ...). 
A program to be generated by the apparatus according to the present invention is a program for generating output data 
20 DO from one set of input data Dl composed of partial input data d k . 

Specifically, if a program for generating output data representing a control quantity for an actuator from detected 
data from a plurality of sensors is to be generated, then the detected data from the sensors are established as partial 
input data d k . Data representing a control quantity for the actuator which is required with respect to the detected data 
from the sensors is established as reference output data SDO. Alternatively, if a program for generating output data 
25 representing an expected stock price for a next day from stock price data in past few days is to be generated, then the 
known stock price on a certain date in the past is established as reference output data SDO, and stock price data in few 
days prior to that date are established as partial input data d k . 

While each of the input data Dl is one-dimensional data in this embodiment, the input data may be two-dimensional 
data or three-dimensional data depending on the type of a program to be generated. 
30 As shown in FIG. 3, each of the computers AGTj (i = 0, 1 , ...) of the computer group 2 comprises memories GN, 

MRO, MR, and registers dp, a, b, f, id, en, ck, gp, mp, en-inv. The memory GN is a memory (program storing means) 
for storing a program. The memory MRO is a memory (address data storing means) for storing a plurality address data 
indicative of addresses to store basic instructions of the program stored in the memory GN. The memory MR is a working 
memory for storing results of arithmetic operations that are carried out when a program stored in the memory GN is 
35 executed. Each of the computers AGTj will hereinafter be referred to as an agent AGTj. 

The register dp is a register for storing data indicative of storage addresses for the partial input data d k of each of 
the input data Dl in the data base 1 . The registers a, b are general-purpose registers used when arithmetic operations 
are carried out. The register f is a register for storing flag data. The register id is a register for storing identification codes 
of the respective agents AGTj. The register en is a register (energy value storing means) for storing data indicative of 
40 an energy value which is established based on the program stored in the memory GN in a manner described later on. 
The register ck is a register for storing data indicative of the number of times that the basic instructions of the program 
are executed. The register gp is a register for storing address data of the memory GN which stores basic instructions 
that are to be successively executed by the agent AGTi during the execution of the program. The register mp is a register 
for storing address data of the memory MR. The register en-inv is a register for storing data representing the number of 
45 times that an fnsh instruction (processing completion instruction) contained in the program. 

The basic instructions used in the apparatus for generating a program according to the present invention will be 
described below. 

The basic instructions used in the apparatus for generating a program according to the present invention are basically 
decision branch instructions, assignment instructions,arithmetic instructions, input and output instructions, and process- 
50 jng completion instructions. Specifically, 25 basic instructions as shown in Table 1 below are used in the apparatus. 



55 




EP 0 696 000 A1 

Table 1 





Names of basic in- 
structions 


Formulas representing the contents 
of basic instructions 


1 


ra* a 


a <r- 0 



10 



15 



20 



25 



30 



35 



40 



45 
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2 


xr •a 


^- — * 

a <— a 1 


5 


3 


sf -a 


a <- a « 1 




4 


de*a 


a <- a - 1 




5 


in* a 


a a + 1 


10 


6 


m-ba 


b ^- a 




7 


a* ab 


a <r- a + b 


15 


8 


s*ab 


a «— a - b, f <— p, n, z 




9 


br *p 


if p(f ) = 1, gp gp + 2 




10 


br-n 


if n(f ) = 1, gp <- gp + 2 


20 


11 


br *z 


if z(f ) = l, gp «- gp + 2 




12 


m* am 


a <— mp 


25 


13 


m*ma 


mp <— a 




14 


de *m 


mp 4- mp - 1 


30 


15 


in*m 


mp «— mp + 1 


16 


m*Ma 


MR[mp] <- a 




1 

17 


ftch 


gp <r- MR[mp], mp <— rap + 1 


35 


18 


oprd 


a <— MR[mp], mp <- mp + 1 




19 


m- ad 


a <— dp 


40 


20 


m*da 


dp <— a 




21 


de*d 


dp dp - 1 




22 


in*d 


dp <— dp + 1 


45 


23 


read 


a <- DI[dp] 




24 


writ 


DO <— a 


SO 


25 


f nsh 


a sign indicating that output data 

are generated , 

en»inv <— en^inv - Eb, 
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>5 



50 







en <— en + (incremental/ dec remental 






value) , ck «- Ccal 



The basic instructions will be described below with reference to Table 1. The ra-a instruction is a basic instruction 
for setting the value of data in the register a to "0", i.e., clearing the data in the register a. The xr-a instruction is a basic 
instruction for inverting the low-order bit of the register a. The sf-a instruction is a basic instruction for shifting the bit 
train (e g 16 bits) of the register a toward the high-order bit thereof and setting the low-order bit to "0". The de-a and 
in-a instructions are basic instructions for decrementing and incrementing, respectively, the value of data in the register 
a by "1 The a-ab instruction is a basic instruction for storing the sum of the value of data in the register a and the value 

of data in the register b in the register a. ,._,«_,. 

The s ab instruction is a basic instruction for subtracting the value of data in the register b from the value of data in 
the register a storing the difference in the register a, and setting only particular bits p. n, z in the reg.ster f to "1", i.e., 
setting a flag, depending on whether the difference is positive (a - b > 0), negative (a - b < 0), or "0" (a - b = 0) The br-p 
br-n, br-z instructions are basic instructions for incrementing the value of address data in the register gp by 2 if each 
of the bits p. n, z in the register f is "1 ". 

The m-am and m-rna instructions are basic instructions for storing data from the registers a, mp respectively in the 
registers mp, a. The de-m and in-m instructions are basic instructions for decrementing and incrementing, respectively, 
the value of data in the register mp by "1 ". 

The m-Ma instruction is a basic instruction for storing data from the register at an address of the working memory 
MR which is indicated by the data in the register mp. The ftch and oprd instructions are basic instructions for storing 
data from an address of the working memory MR which is indicated by the data in the register mp respectively .n the 
registers gp, a, and incrementing the value of address data in the register mp by "1 ". The ftch instruction corresponds 

to a jump instruction. . . 

The m-ad and m-da instructions are basic instructions for storing data from the registers a, dp respectively in the 
registers dp, a. The de-d and in-d instructions are basic instructions for decrementing and incrementing, respectively, 
the value of data in the register dp by "1 ". . 

The read instruction is a basic instruction (reading instruction) for reading partial input data d k of the input data Dl 
stored at an address of the data base 1 which is indicated by the data in the register dp, into the register a. The writ 
instruction is a basic instruction (writing instruction) for writing the data in the register a as generated output data DO 
into the data storage areas D„ of the data base 1 . . 

The fnsh instruction is a basic instruction (processing completion instruction) for causing the agent AGTj to recognize 
the storage of generated output data DO in the data storage areas D n of the data base 1 , subtracting a predetermined 
value Eb from the value of data in the register en-inv, storing the difference in the register en-inv, adding an increment 
or decrements energy value established through the input/output terminal device 4 to an energy value represented by 
the data in the register en. storing the sum in the register en, and initializing the value of data in the register ck wrth a 

predetermined value Ccal. . . 

> A program to be generated, i.e.. a program for generating output data with respect to input data, is composed of 

these basic instructions arranged in a suitable sequence. . 

In this embodiment, each of the basic instructions is represented by a 5-bit binary code, for example. The total 
number of 5-bit binary codes available is 2* = 32, which is greater than the total number (25) of the above basic instruc- 
tions Each of the 32 5-bit binary codes is assigned such that it corresponds to either one of the 25 basic instructions. 
Therefore some of the 25 basic instructions are represented by two or more 5-bit binary codes corresponding thereto. 
A process of generating a program with the apparatus according to the present invention will be o desc " b T e [ d D b i el ° W o 
As shown in FIG 4 each agent AGTj (i = 0, 1 . ...) is initialized by the processing/supervising unit 3 in a STEP1 . The 
initialization is effected on a predetermined number of agents AGT, e.g.. 256 agents AGT, of the computer group 2 as 

f0 " 0 The data of the 5-bit binary codes which represent the basic instructions are randomly stored in the addresses of 
the memory GN of each of the agents AGT, The memory GN of each of the agents AGT, now stores a program which 
is composed of an optional sequence of basic instructions, forming a group of as many programs as the number of 
agents AGT, In this embodiment, the number of addresses of the memory GN. i.e.. the number of basic instructions of 
each of the programs, is 96, for example. 
55 Similarly, the processing/supervising unit 3 stores the address data from the memory GN randomly in the addresses 

of the memory MR0 of each of the agents AGT, The data stored in the memory MR0 is copied into the memory MR. 

The registers of each of the agents AGT; are initialized as follows: The registers dp, gp, mp which store address 
data are initialized to "0" address data, the flag register f is initialized to "0" flag value, and the general-purpose registers 
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a, b are initialized to random data. The register en which stores the data of an energy value indicative of the quality level 
of each program stored in the memory GN is initialized to the same energy value, e.g., of 32, for any of the agents AGTj. 

Since the programs in the agents AGTj thus initialized are each composed of a random sequence of basic instruc- 
tions, the programs may not contain the read instruction, the writ instruction, and the fnsh instruction which will certainly 
5 be required to generate output data with respect to input data, and may contain a plurality of fnsh instructions. 

Then, each of the initialized agents AGTj executes the program in the memory GN using registers, etc. , in accordance 
with commands from the processing/supervising unit 3 in a STEP2. 

Specifically, when each of the initialized agents AGTi starts to execute the program, it initializes the value of data 
in the register ck with the predetermined value Ccal (ck<-Ccal). The predetermined value Ccal is used to limit the number 
10 of times that the basic instructions of each program are executed, as described later on, and is set to "200", for example. 

Furthermore, when each of the initialized agents AGTj starts to execute the program, it sets the value of data in the 
register en-inv to en-inv <- Kxen, and subtracts the value of data in the register en-inv from the energy value in the 
register en (en en - en-inv) where "en" represents the energy value stored in the register en at the time the program 
starts to be executed, and *K" is a predetermined proportionality constant, e.g., 0.1 in this embodiment. The value of 
is data in the register en-inv is now set to a value proportional to the energy value at the time the program starts to be 
executed, i.e. , 1/1 0 of the energy value at the time the program starts to be executed, and the energy value in the register 
en is reduced by the value of data in the register en-inv. The value of data in the register en-inv serves to define the 
number of times that the fnsh instruction is executed depending on the energy value at the time the program starts to 
be executed. 

20 When each of the programs starts being executed, the input data Dl is given from the data base 1 through the 

processing/supervising unit 3 to each of the agents AGTj. Specifically, the processing/supervising unit 3 randomly selects 
one of the data storage regions D n of the data base 1 , and gives the input data Dl in the selected one of the data storage 
regions D a from the data base 1 to each of the agents AGTj. When each of the programs starts being executed, the 
generated output data DO corresponding to the input data Dl from the selected one of the data storage regions D n is 

25 initialized to "0". 

With the memory MR and the registers ck, en-inv thus initialized and the input data Dl given to the agents AGTj, 

each of the agents AGTj starts executing the program. 

More specifically, each of the agents AGTj executes one, at a time, of the basic instructions of the program which 

are stored in the respective addresses of the memory GN, according to the address data stored in the register gp. 
30 Basically, each time each of the agents AGTj executes one basic instruction, it increments the address data in the register 

gp by "1" (gp <- gp + 1). Therefore, the agent AGTj executes the basic instructions of the program stored in the memory 

GN successively from the basic instruction at the address "0" (the first address of the program). 

However, when the agent AGTj executes inebr-p, br-n, and br-z instructions, it may increment the address data 

stored in the register gp by "2" (gp <- gp + 2). At this time, the agent AGTj does not execute the basic instructions at 
35 the addresses that follow the br-p, br-n t and br-z instructions. When the agent AGTj executes the ftch instruction, it 

forcibly rewrites the address data in the register gp with address data indicated by the ftch instruction, and successively 

executes the basic instructions following the basic instruction at the rewritten address. 

More specifically, it is assumed, as shown in FIG. 5, that the br-p instruction is stored at the "lO" address of the 

memory GN in the course of execution of the program in the memory GN successively from the basic instruction at the 
40 "0" address. If the p bit of the flag register f is "1" when the agent AGTj executes the br-p instruction (at this time gp = 

10), then the agent AGTj sets the address data in the register gp to "12" (gp <- gp + 2), and then executes the basic 

instruction at the "1 2" address, rather than the basic instruction at the "11 " address, after the br-p instruction. 

If the ftch instruction is stored in the "20" address of the memory GN and the value of data in the register mp is "3" 

when the agent AGTj executes the br-p instruction (at this time gp = 20), then the agent AGT; writes the address data, 
45 i.e., "35", stored in the "3" address of the memory MR into the register gp (gp <- MR[mp]), and successively executes 

the basic instructions following the basic instruction at the "35" address of the memory GN after the ftch instruction. If 

the ftch instruction is stored in the "55" address of the memory GN and the value of data in the register mp is M 10" when 

the agent AGT S executes the ftch instruction in the course of successive execution of the basic instructions from the 

basic instruction at the "35" address, then the agent AGTj writes the address data, i.e., "60", stored in the "lO" address 
50 of the memory MR into the register gp, and successively executes the basic instructions following the basic instruction 

at the "60" address of the memory GN after the ftch instruction. This means that the basic instructions from the "35" 

address to the M 55" addresses are executed as a subroutine. 

When the address data in the register gp reaches the final address in the memory GN, the agent AGTj resets the 

address data in the register gp to "0", and executes the program again from the basic instruction at the "0" address of 
55 the memory GN. 

When the program starts being executed, the data in the memory MR is copied from the data in the memory MR0 
which stores the address data from the memory GN in the STEP1 (see FIG. 4). The memory MR serves to not only 
store the address data from the memory GN, but also as a working memory when the m-Ma and oprd instructions of 
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the basic instructions are executed. 

Upon execution of the program, the agent AGTj decrements the data indicative of the number of times stored in the 
register ck each time it executes one basic instruction (ck <- ck - 1). Therefore, when the number of times that basic 
instructions are executed reaches the predetermined value Ccal (= 200), the data indicative of the number of times 

5 stored in the register ck becomes "0". When the data indicative of the number of times stored in the register ck becomes 
"0", the agent AGTj finishes the execution of the program. 

When the agent AGTj executes the fnsh instruction before the data indicative of the number of times stored in the 
register ck becomes "0", the data indicative of the number of times stored in the register ck is initialized to the predeter- 
mined value Ccal again as described above with reference to Table 1 . 

10 When the agent AGTj executes the read instruction upon execution of the program, the agent AGTj reads the partial 

input data d k corresponding to the address data in the data base 1 from among the input data Dl in the selected storage 
region D n of the data base 1 , through the processing/supervising unit 3 into the register a. In order to generate accurate 
output data with respect to the input data Dl, it is necessary to read all the partial input data d k contained in the input 
data Dl. The partial input data d k are read in such a manner when as many read instructions as the number of partial 

'5 input data d k are executed as the address data in the register dp is suitably modified by the de-d instruction, etc. (see 
Table 1). The partial input data d k read into the register a are suitably processed when the xr-a instruction, etc. are 
executed. 

When the agent AGT { executes the writ instruction, the agent AGTj stores the data which is stored in the register a 
at the time, as generated output data DO with respect to the input data Dl, into the data storage region D n of the data 
20 base 1 which corresponds to the input data Dl through the processing/supervising unit 3. 

Each time the agent AGTj executes the fnsh instruction contained in the program, the agent AGT f decrements the 
value of data in the register en-inv, i.e., the value of data initialized to a value proportional to the energy value (the value 
of data in the register en) at the time the program starts being executed, by the predetermined value Eb, e.g., of V 
(en-inv <~ en-inv - Eb). 

25 At the same time, the agent AGTj upon execution of the fnsh instruction determines that generated output data with 

respect to the input data Dl has been obtained, and outputs a sign indicating that generated output data with respect to 
the input data Dl has been obtained, to the processing/supervising unit 3. At this time, the processing/supervising unit 
3 outputs the generated output data DO stored in the data storage region D n of the data base 1, together with the 
reference output data SDO stored in the data storage region D n correspondingly to the input data Dl, to the input/output 

30 terminal device 4. The operator, for example, then compares the generated output data DO and the reference output 
data SDO with each other through the input/output terminal device 4, and the energy value in the register en is incre- 
mented or decremented through the input/output terminal device 4, the data base 1, and the processing/supervising 
unit 3 depending on the degree to which the output data DO, SDO agree with each other (en <- en + (incremental/dec- 
remental value). Basically, the greater the degree to which the output data DO, SDO agree with each other, the energy 

35 value in the register en is more incremented, and the smaller the degree to which the output data DO, SDO agree with 
each other, the energy value in the register en is more decremented. The energy value should preferably be incremented 
or decremented in order to satisfy certain conditions, as described later on. 

When the agent AGTj executes the fnsh instruction, the processing/supervising unit 3 newly selects one of the data 
storage regions D n of the data base 1 , and gives the input data in the selected data storage region D n to the agent AGTj. 

to At the same time, the agent AGTj increments or decrements the energy value unless the value of data in the register 
en-inv which is decremented by the predetermined value Eb upon execution of the fnsh instruction is decremented to 
"0", and thereafter executes the basic instruction at the address following the fnsh instruction. When the value of data 
in the register en*inv is decremented to "0", the agent AGTj finishes the execution of the program. 

In the STEP2 shown in FIG. 4, the above execution of the program is carried out successively by the agents AGTj 

45 under the command of the processing/supervising unit 3. At this time, each of the agents AGTj continuously executes 
the basic instructions of the program until the data indicative of the number of times in the register ck falls to "0 H or the 
value of data in the register en-inv falls to M 0 M by executing the fnsh instruction. 

Therefore, the execution of the program by each of the agents AGTj is finished when the number of times that the 
basic instructions are executed reaches the predetermined value Ccal (= 200) without the fnsh instruction being exe- 

50 cuted. Since the value of data in the register en-inv is proportional to the energy value at the time the program starts to 
be executed, the agent AGTj continuously executes the program until the value of data in the register en-inv which is 
decremented by the predetermined value Eb upon execution of the fnsh instruction falls to "0", so that the agent AGTj 
executes as many fnsh instructions contained in the program as the number of times depending on the energy value at 
the time of starting to execute the program unless the data indicative of the number of times in the register ck becomes 

55 "0". As the energy value at the time of starting to execute the program is higher, the number of times that the fnsh 
instruction is executed is greater, and new input data is given each time the fnsh instruction is executed. In the agent 
AGTj which has finished the execution of the program, the register en is set to (en <- en + en-inv), and the register en*inv 
is set to (en-inv ^- 0). 
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Upon completion of the above execution of each program, the selection executing unit 6 of the processing/super- 
vising unit 3 copies or eliminates the program depending on the energy value corresponding to the program in the agent 
AGTj, i.e., the value of data stored in the register en after the execution of the program is finished, in a STEP3 shown 
in FIG. 4. 

5 In this embodiment, an agent AGTj in which the corresponding energy value is "0" is eliminated together with the 

program. Specifically, the data of the program stored in the memory GN and the memory MRO are eliminated from that 
agent AGTj. 

From an agent AGTj in which the corresponding energy value is greater than a predetermined value Ea, e.g., of 
"5", the program is copied to other agents AGTj of the computer group 2. Specifically, the data in the memory GN, the 

10 memory MRO, the register en, etc. of the agent AGTj are copied to the memories GN, the memories MRO, the registers 
en, etc. of the other agents AGTj which do not store the program. In each of the agents AGTj which newly stores the 
program, the copied data in the memory MRO is further copied to the memory MR. The register id is given an identification 
code different from the identification code of the agent AGTj from which the data are copied. The energy value held in 
the agent AGTj from which the data are copied is divided into two halves between the agents AGTj from and to which 

is the data are copied. 

An agent AGTj in which the energy value is equal or smaller than the predetermined value Ea and not "0" remains 
as it is. 

When an agent AGT f is copied or eliminated in the manner described above, such an agent AGTj which has gained 
a relatively large energy value through incrementation upon execution of the program, i.e., such an agent AGTj which 
20 has a superior program that generates output data DO that agrees with the reference output data SDO with a higher 
degree with respect to the input data Dl, is multiplied. 

On the other hand, such an agent AGTj which has an inferior program that only generates output data DO that 
agrees with the reference output data SDO with a lower degree with respect to the input data Dl, is removed. 

After an agent AGTj is copied or eliminated as described above, if the number of multiplied or copied agents AGTj 
25 js in excess of an initially determined number (256) of agents AGTj, then, treating the initially determined number of 
agents AGTj as one generation of agents AGTj, the data in the memories GN, MRO of the agents AGT S are crossed and 
mutated by the crossing executing unit 7 and the mutation executing unit 8 of the processing/supervising unit 3 in a 
STEP4 shown in FIG. 4. If the number of multiplied agents AGTj is smaller than the initially determined number (256) 
of agents AGT j( then the STEP2 and the STEP3 are repeated. 
30 The crossing executing unit 7 crosses data as follows: 

First, pairs of agents AGTj (crossing pairs) which are to cross data are selected randomly in terms of probability at 
a given crossing ratio Rcrs from a group of agents AGTj which store programs. The crossing ratio Rcrs signifies the 
proportion of the agents AGTj which are involved in crossing data in the groupr6r agents AGTj. In this embodiment, the 
crossing ratio Rcrs is set to 0.3 (30 %), for example. Specifically, if the total number of agents AGTi in the group is "100", 
35 then 30 agents AGTj (1 5 crossing pairs), which are 30 % on the average of the total number of agents AGT j( are selected 
as those agents AGTj which are involved in crossing data. Since, however, crossing pairs of agents AGT ( are selected 
randomly in terms of probability, not 30 % of the total number of agents AGTj are necessarily selected at all times. 
The data (programs) in the memories GN are crossed between the selected crossing pairs of agents AGTj as follows: 
As shown in FIG. 6(a), upper and lower bit trains are illustrative of 5-bit binary codes (basic instruction codes) 
40 representing basic instructions of the programs of a crossing pair, the 5-bit binary codes being arranged serially suc- 
cessively in the order of addresses of the memories GN. For crossing the programs, boundaries are established with a 
given probability Pcrs between bits of respective basic instruction codes. The probability Pcrs is a probability with which 
to establish a boundary in one basic instruction code, and is set to "1" in this embodiment. Therefore, one boundary on 
the average is established in each basic instruction code. The position of a boundary in each basic instruction code is 
45 determined randomly. In FIG. 6(a), a boundary is established between second and third bits of the left-hand basic in- 
struction code, and a boundary is established between first and second bits of the next right-hand basic instruction code. 

Having thus established boundaries, the crossing executing unit 7 exchanges bit trains between the programs of 
the crossing pair, i.e., changes a bit train (crossing region) between the adjacent boundaries shown in FIG. 6(a) to a bit 
train shown in FIG. 6(b), for thereby crossing the programs of the crossing pair. When the programs of the crossing pair 
50 are thus crossed, the basic instruction in the crossing region in each of the programs of the crossing pair changes to 
another basic instruction. Therefore, each of the programs of the crossing pair newly contains a series of basic instruc- 
tions which have not been contained. 

Such data crossing is also effected in the same manner on the data (address data) in the memories MRO of the 
crossing pair. 

55 The programs of the crossing pair may be crossed by exchanging basic instructions from a certain address to 

another address in the memories GN between the programs. This holds true for data crossing on the data (address 
data) in the memories MRO of the crossing pair. 

The mutation executing unit 8 mutates data as follows: 
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As shown in FIG. 7(a), a bit train is illustrative of 5-bit binary codes (basic instruction codes) representing basic 
instructions of the program of each agent AGTj, the 5-bit binary codes being arranged serially successively in the order 
of addresses of the memory GN. The program is mutated by inverting the bits of the bit train with a predetermined 
probability Pmut as shown in FIG. 7(b). The probability Pmut is a probability with which the value of each bit is inverted. 
s In this embodiment, the probability Pmut is set to M 0.005", for example, signifying that the values of 5 bits per 1000 bits 
on the average (1 bit per 200 bits) of the bit train of a program are inverted. Specifically, since one program comprises 
a bit train of 5 x 96 addresses = 480 bits in this embodiment, the number of bits of the program whose values are 
inverted by the mutation executing unit 8 ranges from 2 to 3 on the average. Such a mutation is effected on each of the 
programs by the mutation executing unit 8. 
io When such a mutation occurs, a basic instruction corresponding to a basic instruction code which contains a bit 

with its value inverted is mutated into a different basic instruction. 

The above mutation is also carried out on the address data in the memory MR0 of each of the agents AGTj. 
Each of the programs may be mutated by selecting several basic instructions in terms of probability from the basic 
instructions that make up the program, and randomly mutating the selected basic instructions into other basic instruc- 
ts tions. This holds true for data mutation on the address data in the memory MR0. 

After the above crossing and mutation step, the energy value (the value of data in the memory en) corresponding 
to each of the agents AGTj is standardized in a STEPS such that the total amount of energy values is kept at a constant 
value (given total amount) equal to the total amount (256 x 32 = 81 92 in this embodiment) of energy values established 
depending on the programs in the STEP1 . The energy value is standardized by distributing the total amount of energy 
20 values to the programs at proportions proportional to the energy values that are presently stored in the registers en for 
the respective programs, and then storing the distributed energy values in the respective registers en. The energy value 
is thus standardized for the reason of preventing the energy value from being infinitely reduced or increased depending 
on the program capability of the agent AGT f . 

Subsequently, the processing from the STEP2 to the STEP5, i.e., the execution of the program by each of agents 
25 AGTj, the copying or elimination thereof, the crossing and mutation thereof, and the standardization of the energy value, 
is repeated for thereby generating an agent AGTj which has a superior program that generates output data DO that 
agrees with the reference output data SDO with a higher degree with respect to the various input data Dl in the data 
base 1, and also multiplying such an agent AGTj so that it will be eventually prevalent in the group of agents AGTj. 
More specifically, when each program is executed, an energy value corresponding to an agent AGTj having a pro- 
30 gram for generating output data DO that agrees with the reference output data SDO with a high degree with respect to 
input data Dl given at the time upon execution of the fnsh instruction, and writing the generated output data DO in the 
data base 1 according to the writ instruction, is increased each time the fnsh instruction is executed, and such an agent 
AGTj is copied or eliminated depending on the magnitude of the energy value, and remains and multiplied in the computer 
group 2. While the STEP2 is being repeated after the STEP 3 through the STEPS, an energy value corresponding to 
35 an agent AGTj having a program for generating output data DO that agrees with the reference output data SDO with a 
low degree with respect to input data Dl given at the time upon execution of each of the programs is reduced, and hence 
the agent AGTj is copied or eliminated in the STEP3, and thereafter eliminated (weeded out). For example, an agent 
AGTj having a program that does not contain the read instruction for reading input data Dl (such a program can be 
generated upon initialization in the STEP1 or crossing or mutation in the STEP4) will eventually be eliminated or weeded 
40 out as the program fails to generate accurate output data DO with respect to various input data Dl. 

It would not be possible to leave and multiply an agent AGTj having a program better than a program for generating 
most accurate output data DO among the programs first generated in the STEP1 , simply by copying or eliminating an 
agent AGTj. However, a program for generating more accurate output data DO can be obtained by crossing and mutating 
the data in the STEP4 from time to time. 
■*s Specifically, some basic instructions change to other basic instructions in a program which has been subjected to 

a crossing or mutation as described above. When some basic instructions are thus changed, an arrangement of basic 
instructions (hereinafter referred to as a "functional block") effective to generate more accurate output data DO may be 
generated in a suitable portion of the program. For instance, if the xr-a instruction, the m-ba instruction, and the a-ab 
instruction of the basic instructions have to be arranged in the order named on a low-order side of the read instruction 
50 for generating more accurate output data DO, then such an arrangement of the instructions serves as a functional block. 

If the number of agents AGTj having a program containing such a functional block is small in the crossing step, then 
when the program is crossed with another program, it may be crossed with a program containing no functional block 
with a high probability, and hence the functional block of the program may be broken also with a high probability. However, 
the program may not necessarily be crossed with another program at all times, and if the program is not crossed with 
55 another program, then the program is copied in the STEP3 and multiplied. When the number of programs containing 
such a functional block is increased to a certain extent, programs containing a functional block may be crossed with 
each other with a high probability. For this reason, and since the crossing is an exchange between some basic instruction 
codes at corresponding regions of the programs, the functional blocks of these programs are maintained. Inasmuch as 
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a program containing a functional block generates more accurate output data DO with respect to various input data Dl 
than a program which contains no functional block, the program containing a functional block gains a higher energy 
value when the program is executed in the STEP2. Consequently, an agent AGTj having a program containing such a 
functional block is copied in the STEP3, and is multiplied and becomes prevalent in the group of agents AGTj. 

In the mutating step, when a mutation occurs in a functional block of a program, the functional block is broken, and 
therefore an agent AGTj having a program containing such a broken functional block is eliminated in the STEP3 and 
weeded out. If a mutation occurs in a portion of a program other than a functional block thereof, then since the program 
remains rather than being eliminated, the mutated portion remains in the program. 

While a mutation may generate a program having an effective functional block, it generally breaks a program having 
a functional block and modifies it into an inferior program with a high probability. Therefore, the probability that such a 
mutation occurs is set to a substantially small value (« 1 ) in order to allow a functional block to grow beyond a certain 
length. 

In the crossing step, mutated portions accumulated in a portion of a program other than a functional block by the 
mutating process while maintaining such a functional block may be crossed to generate a new functional block more 
effective to generate more accurate output data DO, in the portion other than the functional block. Since the program 
with such a new functional block generated therein can generate more accurate output data DO, the program gains a 
higher energy value when the program is executed in the STEP2. Consequently, an agent AGTj having such a program 
is copied in the STEP3, and is multiplied and becomes prevalent in the group of agents.AGTj. 

In this manner, an agent AGTj which has a superior program that generates output data DO. that agrees with the 
reference output data SDO with a higher degree with respect to the input data Dl, is generated and multiplied until finally 
a program for generating optimum output data DO with respect to the input data Dl is generated. Because the operator 
is only required to increment or decrement the energy value and the processing/supervising unit 3 automatically carries 
out other processing, the manual labor needed to generate a program is minimized. 

In the execution of a program in the STEP2, the fnsh instruction is executed a number of times depending on the 
energy value at the time the program starts being executed, i.e., the energy value which is gained by an agent AGTj 
that finally has the program when the program is executed in a preceding cycle, and new input data Dl is given each 
time the fnsh instruction is executed. Consequently, an agent AGTj that has an inferior program which does not generate 
accurate output data DO with respect to various input data Dl is quickly weeded out (eliminated) in the STEP3, and an 
agent AGTj that has a superior program which generates accurate output data DO with respect to various input data Dl 
is copied in the STEP3 and quickly multiplied. 

Specifically, each program generates output data DO with respect to input data Dl when suitable basic instructions 
including the read instruction and the writ instruction are executed before the fnsh instruction is executed, and the energy 
value is incremented or decremented when the fnsh instruction is executed. At this time, even if the degree with which 
the output data DO and the reference output data SDO agree with each other is high, it depends on given input data 
Dl, and accurate output data DO may often not be generated with respect to other input data Dl by the above group of 
basic instructions. Therefore, even if a relatively large energy value is gained when the program is executed once, it 
may have been gained because the input data Dl given upon execution of the program is certain particular input data 
Dl. Since the program containing such a group of basic instructions is unable to generate accurate output data DO with 
respect to various input data Dl, the program should be weeded out quickly. 

In this embodiment, the fnsh instruction is executed a number of times depending on the energy value at the time 
the program starts being executed, and new input data Dl is given each time the fnsh instruction is executed. Therefore, 
an agent AGTj which has gained a relatively large energy value upon execution of the program in a preceding cycle 
executes the above group of basic instructions an increased number of times, and is given new input data Dl each time 
the group of basic instructions is executed. 

If the above group of basic instructions is capable of generating accurate output data DO with respect to various 
input data Dl, then the energy value of the program which contains the group of basic instructions is increased each 
time the fnsh instruction is executed, and the program gains a greater energy value, so that the program can be copied 
and multiplied in the STEP3 with greater ease. Conversely, if the above group of basic instructions is capable of gen- 
erating accurate output data DO with respect to only particular input data Dl, then the energy value of the program which 
contains the group of basic instructions is often reduced each time the fnsh instruction is executed, and the energy value 
eventually falls to "O", so that the program is weeded out in the STEP3. Consequently, an agent AGTj which has a 
superior program is quickly multiplied, and an agent AGTj which has an inferior program is quickly weeded out, with the 
result that a superior program can be generated more quickly. 

In this embodiment, when the data indicative of the number of times stored in the register ck becomes M 0" upon 
execution of each program, i.e., when the number of times that basic instructions are executed reaches the predeter- 
mined value Ccal after the execution of the program is started until the fnsh instruction is executed, or after an fnsh 
instruction is executed until a next fnsh instruction is executed, the execution of the program is finished. Therefore, the 
execution of the program is prevented from continuing infinitely in the case where the program contains an arrangement 
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of basic instructions forming an infinite loop. 

Furthermore, when the ftch instruction is executed upon execution of each program, the basic instructions following 
the basic instruction at the address based on the address data copied from the memory MRO to the memory MR are 
executed as a subroutine. The arrangement of the basic instructions as the subroutine basically depends on the address 
data stored in the memory MRO, and when the address data stored in the memory MRO becomes suitable for the program 
while programs are being copied or eliminated, and crossed or mutated, a subroutine program appropriate for generating 
accurate output data DO may be produced in the program. 

In this embodiment, the address data in the memory MRO are crossed and mutated in the manner described above 
while the programs in the memories GN are crossed and mutated. In this manner/a program containing a subroutine 
program appropriate for generating accurate output data DO is generated in the memory G N of each of the agents AGTj. 

For multiplying an agent AGTj having a program for generating accurate output data DO until it becomes prevalent 
in the group of agents AGTj, it is preferable to give an energy value to each of agents AGTj in a manner to satisfy certain . 
conditions when each of the programs is executed. 

Specifically, if a group of agents AGTj is composed of agents AGTj each having a program containing a functional 
block (an arrangement of basic instructions) effective to generate accurate output data DO and agents AGTj each having 
a program containing no such functional block, then when the programs are executed, each of the programs containing 
a functional block (referred to as a "superior program") gains a greater energy value than the programs containing no 
such functional block (referred to as an "inferior program"). Therefore, in the STEP3, an agent AGTj having a superior 
program is copied and multiplied, and an agent AGTj having an inferior program remains as it is or is eliminated. There- 
fore, after agents have been copied or eliminated, the proportion of superior programs in the entire group, i.e., the ratio 
of the number of superior programs to the entire number of programs, is greater than it was before agents have been 
copied or eliminated. 

It is assumed that, as a result of the copying or eliminating step, the number of superior programs changes from 
NO to NOsel and the number of inferior programs changes from Na to Nasel, and the rate of change (rate of increase) 
NOsel/NO of the number of superior programs is (1 + s) times (s > 0) the rate of change Nasel/Na of the number of inferior 
programs. After the copying or eliminating step, the proportion YOsel (= N0sel/(N0sel + Nasel), 0 < YOsel < 1) of the 
number NOsel of superior programs in the total number (NOsel + Nasel) of programs in the group is expressed according 
to the following equation, using the proportion Y0 (= N0/(N0 + Na)) of the number NO of superior programs in the total 
number (NO + Na) of programs in the group before being copied or eliminated: 

YOsel = Y0 (1 +s)/(1 +sY0) (1) 
where the denominator of the right side represents the total number of programs in the group after being copied or 
eliminated, and the numerator of the right side represents the number of superior programs after being copied or elim- 
inated. 

The symbol V in the above equation is a parameter indicating the extent to which superior programs are multiplied 
by being copied over inferior programs. A program is copied or eliminated depending on the energy value gained when 
the program is executed, and upon execution of the program, the energy value of a superior program is incremented or 
decremented so as to gain an energy value greater than that of an inferior program. The symbol "s" is basically a quantity 
proportional to the magnitude of the energy value that is increased when the program is executed. 

It is assumed that the probability that a functional block of a superior program is broken, i.e., the probability that an 
optional basic instruction in a functional block is mutated into another basic instruction, in the mutating step, is indicated 
by u (u « 1 ). Since the probability that an optional arrangement of basic instructions of an inferior program is mutated 
into an arrangement of basic instructions serving as a functional block is about "0", the proportions Y0, YOmut of superior 
programs in the group respectively before and after a mutation takes place satisfy the following equation: 

YOmut = Y0(1 -u) (2) 
where V is proportional to the probability Pmut described above with respect to the mutation. 

If it is assumed that the proportions of superior programs in the group respectively before and after a crossing takes 
place are represented respectively by Y0, YOcrs, then the proportions Y0, YOcrs satisfy the following equation: 

YOcrs = (1 - Rcrs)Y0 + Rcrs [YO 2 + Y0 (1 - Y0)Ppres] (3) 

where Rcrs is the crossing ratio described above, and Ppres is the probability that a functional block of a superior program 
remains unbroken when the superior program and an inferior program are crossed with each other as a crossing pair, 
the probability Ppres depending strongly on Y0. 

While a detailed process of deriving the equation (3) is not described here, "(1 - Rcrs)Y0" in the first term of the right 
side of the equation (3) represents the proportion of the number of those superior programs which are not involved in 
the crossing step, i.e., which are not crossed, of all superior programs before being crossed in the entire group, as is 
evident from the definition of the crossing ratio. 

"Rcrs [YO 2 + Y0 (1 - Y0)Ppres]" in the second term of the right side of the equation (3) represents the proportion of 
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the number of those superior programs which are involved in the crossing step and have functional blocks maintained 
after being crossed, of all superior programs before being crossed in the entire group. The equation (3) shows that the 
sum of the first and second terms of the right side thereof is equal to the proportion YO of the number of superior programs 
after being crossed in the entire group. 

s The second term of the right side of the equation (3) will be described in greater detail below. When a superior 

program is involved in the crossing step and its functional block is maintained, either superior programs are crossed as 
a crossing pair with each other or superior and inferior programs are crossed as a crossing pair with each other with a 
functional block being maintained. Crossing inferior programs each other can be ignored because the probability that a 
superior program having a functional block will be generated is small. "YO 2 " in the bracket of the second term of the right 

10 side of the equation (3) represents the proportion of the total number of combinations of superior programs as crossing 
pairs in the total number of all combinations of programs possible as crossing pairs in the group of programs before 
being crossed. In such crossing pairs, the functional block of each superior program is always maintained, i.e., the 
probability that the functional block of each superior program is maintained is M 1V M Y0 (1 - YO)" in the bracket of the 
second term of the right side of the equation (3) represents 1/2 of the proportion of the total number of combinations of 

is superior and inferior programs as crossing pairs in the total number of all combinations of programs possible as crossing 
pairs in the group of programs before being crossed. In such crossing pairs, the functional block of a superior program 
is maintained insofar as the superior and inferior programs are crossed with each other in portions not related to the 
functional blocks of superior programs. Therefore, "YO (1 - Y0)Ppres" which indicates the product of "YO (1 - YO) - and 
the probability Pres that the functional block of a superior program is maintained when the superior program and an 

20 inferior program are crossed with each other at portions not related to the functional block, represents the proportion of 
superior programs obtained from crossing pairs of superior and inferior programs. 

Consequently, the sum of "YO 2 " and "YO (1 - Y0)Ppres" represents the proportion of superior programs involved in 
the crossing step and functional blocks thereof which are maintained, in the total number of all combinations of programs 
as crossing pairs. The second term of the right side of the equation (3), which represents the product of the sum of "YO 2 " 

25 and "YO (1 - Y0)Ppres" and the crossing rate "Rcrs", indicates the proportion of the number of superior programs which 
are involved in the crossing step and whose functional blocks are maintained after the crossing step, in the total number 
of programs in the group. 

From the equations (1) ~- (3), the proportion YO' of superior programs in the group after the copying or eliminating 
step and the mutating or crossing step has been carried out is expressed by the following equation, using the proportion 
30 YO of superior programs in the group before those steps are carried out: 

YO' = YO-Asel-Amut-Acrs (4) 

where Asel = (1 + s)/(1 + sYO), 
Amut = 1 - u t and 

Acrs = (1 - Rcrs) + Rcrs [YO + (1 - Y0)Pres]. 

35 Since the present invention resides basically in that superior programs are generated and multiplied in the group 

of programs, it is necessary that the proportion of superior programs in the group be increased after the copying or 
eliminating step and the mutating or crossing step has been carried out, i.e., it is necessary that the condition: AYO = 
YO' - YO > 0 be satisfied. As can be seen from the equation (4), the above condition is equivalent to the inequality: 
Asel- Amut- Acrs > 1 . Using Ppres = 0, YO « 1 , the above inequality can be modified into: 

40 (1 + s)(1 - Rcrs)(1 - u) > 1 (5) 

Specifically, in this embodiment, the crossing rate "Rcrs" and V are set to Rcrs = 0.3 and u = 0.005 (= Ppres), 
respectively. In order to satisfy the inequality (5), "s" must be in the range of s > 0.44. If V = 0.5, then the inequality (5) 
is satisfied. This means that, as is apparent from the above definition of "s", when the energy value corresponding to 
each program is incremented or decremented in the execution of the program before the copying or eliminating step 

45 such that the rate of change (rate of increase) NOsel/NO of the number of superior programs becomes 1.5 times, for 
example, the rate of change Nasel/Na of the number of inferior programs in the copying or eliminating step, superior 
programs are multiplied in the group of agents AGTj until they are prevalent in the group. 

Although a certain preferred embodiment of the present invention has been shown and described in detail, it should 
be understood that various changes and modifications may be made therein without departing from the scope of the 

50 appended claims. 



Claims 

55 1. An apparatus for generating a program, comprising: 

program storing means (2) for storing a plurality of programs each composed of an arrangement of basic 
instructions of plural types required to generate output data with respect to given input data of given types; 

energy value storing means for storing data indicative of an energy value indicative of the quality level of each 
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of the programs; 

a computer (AGTj) for executing each of the programs until a predetermined condition is satisfied; 
input data imparting means (1 ,4) for giving said input data to said computer when the computer executes each 
of the programs; 

energy value setting means for setting an energy value to increment or decrement the energy value corre- 
sponding to each of the programs which is stored in said energy value storing means depending on the degree with 
which the output data generated by each of the programs executed by said computer and reference output data 
predetermined with respect to said input data agree with each other; 

selecting means (6) for copying or eliminating each of the programs depending on the magnitude of the energy 
value stored in said energy value storing means and storing a plurality of programs generated by copying or elim- 
inating each of the programs into said program storing means, after the execution of each of the programs by said 
computer is finished; 

crossing means (7) for crossing the programs stored in said program storing means with a predetermined 
probability; and 

mutating means (8) for mutating the programs stored in said program storing means with a predetermined 
probability; 

said energy value setting means having means for setting the energy value corresponding to each of the 
programs so as to increment the energy value when the degree with which the generated output data and the 
reference output data agree with each other is higher; 

said computer (AGTj), said selecting means (6), said crossing means (7), and said mutating means (8) having 
respective means for repeatedly executing each of the programs, copying or eliminating each of the programs, 
crossing the programs, and mutating each of the programs to generate a program for generating output data with 
respect to the input data with a high degree of agreement with said reference output data, in said programs stored 
in said program storing means. 

2. An apparatus according to claim 1 , wherein said crossing means (7) comprises means for selecting at least a pair 
of programs as a crossing pair from said plurality of programs with a predetermined probability, and crossing the 
selected programs by exchanging a portion of an arrangement of basic instructions or a bit train of each of the 
selected programs with a predetermined probability. 

3. An apparatus according to claim 1 or 2, wherein said mutating means (8) comprises means for mutating each of 
the programs by either changing a basic instruction of an arrangement of basic instructions of each of the programs 
to another basic instruction with a predetermined probability or inverting the value of a bit of a bit train of each of 
the programs with a predetermined probability. 

4. An apparatus according to claim 1 , 2 or 3, wherein said basic instructions include an input data reading instruction 
for reading the input data and a processing completion instruction for indicating the generation of the output data, 
said computer (AGTj) comprising means for executing said processing completion instruction a number of times 
depending on said energy value at the time of starting to execute each of the programs when each of the programs 
is executed, said input data imparting means comprising means for giving new input data to said computer each 
time said processing completion instruction is executed when each of the programs is executed by said computer. 

5. An apparatus according to any preceding claim, wherein said computer comprises means for finishing execution of 
each of the programs when the number of times that the basic instructions of each of the programs are executed 
reaches a predetermined number. 

6. An apparatus according to any preceding claim, wherein said crossing means (7) and said mutating means (8) 
comprise respective means for crossing the programs and mutating the programs, respectively, when the number 
of programs copied by said selecting means (6) reaches at least a predetermined number. 

7. An apparatus according to any preceding claim, further comprising address data storing means for storing address 
data representing an address of at least one of the basic instructions of each of the programs stored in said program 
storing means; 

said basic instructions including a jump instruction for shifting the execution of the program to the basic instruc- 
tion at the address represented by the address data stored in said address data storing means when each of the 
programs is executed by said computer; 

said selecting means (6) comprising means for copying or eliminating the address data stored in said address 
data storing means in association with each of said programs when each of said programs is copied or eliminated; 
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said crossing means (7) comprising means for crossing the address data stored in said address data storing 
means with a predetermined probability in association with the programs when the programs are crossed; 

said mutating means (8) comprising means for mutating the address data stored in said address data storing 
means with a predetermined probability in association with each of said programs when each of said programs is 
5 mutated. 



8. A method of generating a program, comprising the steps of: 

generating a plurality of programs each composed of an arrangement of basic instructions of plural types 
required to generate output data with respect to given input data of given types; 
10 executing each of the programs with a computer until a predetermined condition is satisfied and giving the 

input data to said computer; 

comparing output data generated with respect to the input data when each of the programs is executed, with 
reference output data predetermined with respect to said input data, and incrementing or decrementing an energy 
value indicative of the quality level of each of the programs such that the energy value is greater as the degree with 
is which the generated output data and the reference output data agree with each other is higher; 

copying or eliminating each of the programs depending on the magnitude of the energy value after the exe- 
cution of each of the programs by said computer is finished; 

crossing the programs with a predetermined probability; and 
mutating the programs with a predetermined probability; 
20 said steps of executing, incrementing or decrementing, copying or eliminating, crossing, and mutating being 

repeated to generate a program for generating output data with respect to the input data with a high degree of 
agreement with said reference output data. 

9. A method according to claim 8, wherein said step of crossing comprises the steps of selecting at least a pair of 
25 programs as a crossing pair from said plurality of programs with a predetermined probability, and crossing the 

selected programs by exchanging a portion of an arrangement of basic instructions or a bit train of each of the 
selected programs with a predetermined probability. 

10. A method according to claim 8 or 9, wherein said step of mutating comprises the step of mutating each of the 
30 programs by either changing a basic instruction of an arrangement of basic instructions of each of the programs to 

another basic instruction with a predetermined probability or inverting the value of a bit of a bit train of each of the 
programs with a predetermined probability. 

11. A method according to claim 8, 9 or 10, wherein said basic instructions include an input data reading instruction for 
35 reading the input data and a processing completion instruction for indicating the generation of the output data, said 

steps of executing and giving comprising the steps of executing said processing completion instruction a number 
of times depending on said energy value at the time of starting to execute each of the programs when each of the 
programs is executed, and giving new input data to said computer each time said processing completion instruction 
is executed. 

40 

12. A method according to claim 8, 9, 1 0 or 1 1 , wherein said step of executing comprises the step of finishing execution 
of each of the programs when the number of times that the basic instructions of each of the programs are executed 
reaches a predetermined number 

A method according to claim 8, 9, 10, 11 or 12, wherein said steps of crossing and mutating comprise the steps of 
crossing the programs and mutating the programs, respectively, when the number of copied programs reaches at 
least a predetermined number. 

A method according to any of claims 8 to 13, wherein said step of generating comprises the step of establishing 
position data representing a position of at least one of the basic instructions of each of the programs in association 
with each of the programs; 

said basic instructions including a jump instruction for shifting the execution of the program to the basic instruc- 
tion at the position represented by the position data established in said step of establishing when each of the pro- 
grams is executed by said computer; 

said step of selecting comprising the step of copying or eliminating the position data in association with each 
of said programs when each of said programs is copied or eliminated; 

said step of crossing comprising the step of crossing the position data with a predetermined probability in 
association with the programs when the programs are crossed; 
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said step of mutating comprising the step of mutating the position data with a predetermined probability in 
association with each of said programs when each of said programs is mutated. 
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